Statistical Methodology for Quality Comparison between Algorithms
نویسنده
چکیده
Performance on the quality of the responses obtained by two algorithms, it is not something to be taken lightly. Most of the tests used, are based on the calculation of average, however, this statistic can be affected by extreme results. In addition, a mean difference may be statistically insignificant in practical terms can be decisive. In this paper we propose a statistical test that solved the mentioned problems. The proposed methodology in this research also determines the sample size and the probability that there is significant difference when really there is not (Type II error), factors that generally are not considered in traditional tests.Keywords-Comparison of Algorithms, Number of instances, Optimization, Statistical test, Type II error.
منابع مشابه
Subjective comparison and evaluation of speech enhancement algorithms
Making meaningful comparisons between the performance of the various speech enhancement algorithms proposed over the years, has been elusive due to lack of a common speech database, differences in the types of noise used and differences in the testing methodology. To facilitate such comparisons, we report on the development of a noisy speech corpus suitable for evaluation of speech enhancement ...
متن کاملCOMPARISON OF FILTRATION PERFORMANCE BETWEEN NEAT AND PLASMA-TREATED PAN / MGO NANOFIBERS IN THE REMOVAL OF 10 TO 1000 NM PARTICLES
Introduction: The present study aimed to compare the filtration performance between neat hybrid electrospun nanofibers consisting of polyacrylonitrile (PAN) polymer and magnesium oxide (MgO) nanoparticles and plasma treated ones in removing fine particles from the air stream. Methodology: The upper surface of the nanofibers were processed by cold-plasma with a radio frequency power supply (13....
متن کاملA Novel Heuristic Optimization Methodology for Solving of Economic Dispatch Problems
This paper presents a biogeography-based optimization (BBO) algorithm to solve the economic loadDispatch (ELD) problem with generator constraints in thermal plants. The applied method can solvethe ELD problem with constraints like transmission losses, ramp rate limits, and prohibited operatingzones. Biogeography is the science of the geographical distribution of biological species. The modelsof...
متن کاملPossibilistic Methodology for the Evaluation of Classification Algorithms
In the paper we consider the problem of the statistical evaluation and comparison of different classification algorithms. For this purpose we apply the methodology of statistical tests for testing independence in the case the multinomial distribution. We propose to use two-sample tests for the comparison of different classification algorithms. In the paper we consider only the case of the super...
متن کاملApplication of Genetic Algorithms for Pixel Selection in MIA-QSAR Studies on Anti-HIV HEPT Analogues for New Design Derivatives
Quantitative structure-activity relationship (QSAR) analysis has been carried out with a series of 107 anti-HIV HEPT compounds with antiviral activity, which was performed by chemometrics methods. Bi-dimensional images were used to calculate some pixels and multivariate image analysis was applied to QSAR modelling of the anti-HIV potential of HEPT analogues by means of multivariate calibration,...
متن کامل